Reinforcement learning in populations of spiking neurons

Population coding is widely regarded as a key mechanism for achieving reliable behavioral responses in the face of neuronal variability. But in standard reinforcement learning a flip-side becomes apparent. Learning slows down with increasing population size since the global reinforcement becomes less and less related to the performance of any single neuron. We show that, in contrast, learning speeds up with increasing population size if feedback about the populationresponse modulates synaptic plasticity in addition to global reinforcement. The two feedback signals (reinforcement and population-response signal) can be encoded by ambient neurotransmitter concentrations which vary slowly, yielding a fully online plasticity rule where the learning of a stimulus is interleaved with the processing of the subsequent one. The assumption of a single additional feedback mechanism therefore reconciles biological plausibility with efficient learning

Signed Laplacian Deep Learning with Adversarial Augmentation for Improved Mammography Diagnosis

Computer-aided breast cancer diagnosis in mammography is limited by inadequate data and the similarity between benign and cancerous masses. To address this, we propose a signed graph regularized deep neural network with adversarial augmentation, named \textsc{DiagNet}. Firstly, we use adversarial learning to generate positive and negative mass-contained mammograms for each mass class. After that, a signed similarity graph is built upon the expanded data to further highlight the discrimination. Finally, a deep convolutional neural network is trained by jointly optimizing the signed graph regularization and classification loss. Experiments show that the \textsc{DiagNet} framework outperforms the state-of-the-art in breast mass diagnosis in mammography.Comment: To appear in MICCAI October 201

Distinct profiles of myelin distribution along single axons of pyramidal neurons in the neocortex.

Myelin is a defining feature of the vertebrate nervous system. Variability in the thickness of the myelin envelope is a structural feature affecting the conduction of neuronal signals. Conversely, the distribution of myelinated tracts along the length of axons has been assumed to be uniform. Here, we traced high-throughput electron microscopy (EM) reconstructions of single axons of pyramidal neurons in the mouse neocortex and built high-resolution maps of myelination. We find that individual neurons have distinct longitudinal distribution of myelin. Neurons in the superficial layers displayed the most diversified profiles, including a new pattern where myelinated segments are interspersed with long, unmyelinated tracts. Our data indicate that the profile of longitudinal distribution of myelin is an integral feature of neuronal identity and may have evolved as a strategy to modulate long-distance communication in the neocortex

The solar eclipse and associated atmospheric variations observed in South Korea on 22 July 2009

A partial solar eclipse occurred in South Korea on 22 July 2009. It started at 09:30 a.m. and lasted until 12:14 LST with coverage of between 76.8% and 93.1% of the sun. The observed atmospheric effects of the eclipse are presented. It was found that from the onset of the eclipse, solar radiation was reduced by as much as 88.1 ∼ 89.9% at the present research centre. Also, during the eclipse, air temperature decreased slightly or remained almost unchanged. After the eclipse, however, it rose by 2.5 to 4.5°C at observed stations. Meanwhile, relative humidity increased and wind speeds were lowered by the eclipse. Ground-level ozone was observed to decrease during the event

Applications of Information Theory to Analysis of Neural Data

Information theory is a practical and theoretical framework developed for the study of communication over noisy channels. Its probabilistic basis and capacity to relate statistical structure to function make it ideally suited for studying information flow in the nervous system. It has a number of useful properties: it is a general measure sensitive to any relationship, not only linear effects; it has meaningful units which in many cases allow direct comparison between different experiments; and it can be used to study how much information can be gained by observing neural responses in single trials, rather than in averages over multiple trials. A variety of information theoretic quantities are commonly used in neuroscience - (see entry "Definitions of Information-Theoretic Quantities"). In this entry we review some applications of information theory in neuroscience to study encoding of information in both single neurons and neuronal populations.Comment: 8 pages, 2 figure

Robustness of Learning That Is Based on Covariance-Driven Synaptic Plasticity

It is widely believed that learning is due, at least in part, to long-lasting modifications of the strengths of synapses in the brain. Theoretical studies have shown that a family of synaptic plasticity rules, in which synaptic changes are driven by covariance, is particularly useful for many forms of learning, including associative memory, gradient estimation, and operant conditioning. Covariance-based plasticity is inherently sensitive. Even a slight mistuning of the parameters of a covariance-based plasticity rule is likely to result in substantial changes in synaptic efficacies. Therefore, the biological relevance of covariance-based plasticity models is questionable. Here, we study the effects of mistuning parameters of the plasticity rule in a decision making model in which synaptic plasticity is driven by the covariance of reward and neural activity. An exact covariance plasticity rule yields Herrnstein's matching law. We show that although the effect of slight mistuning of the plasticity rule on the synaptic efficacies is large, the behavioral effect is small. Thus, matching behavior is robust to mistuning of the parameters of the covariance-based plasticity rule. Furthermore, the mistuned covariance rule results in undermatching, which is consistent with experimentally observed behavior. These results substantiate the hypothesis that approximate covariance-based synaptic plasticity underlies operant conditioning. However, we show that the mistuning of the mean subtraction makes behavior sensitive to the mistuning of the properties of the decision making network. Thus, there is a tradeoff between the robustness of matching behavior to changes in the plasticity rule and its robustness to changes in the properties of the decision making network

A Compromise between Neutrino Masses and Collider Signatures in the Type-II Seesaw Model

A natural extension of the standard $SU(2)_{\rm L} \times U(1)_{\rm Y}$ gauge model to accommodate massive neutrinos is to introduce one Higgs triplet and three right-handed Majorana neutrinos, leading to a $6\times 6$ neutrino mass matrix which contains three $3\times 3$ sub-matrices $M_{\rm L}$, $M_{\rm D}$ and $M_{\rm R}$. We show that three light Majorana neutrinos (i.e., the mass eigenstates of $\nu_e$, $\nu_\mu$ and $\nu_\tau$) are exactly massless in this model, if and only if $M_{\rm L} = M_{\rm D} M_{\rm R}^{-1} M_{\rm D}^T$ exactly holds. This no-go theorem implies that small but non-vanishing neutrino masses may result from a significant but incomplete cancellation between $M_{\rm L}$ and $M_{\rm D} M_{\rm R}^{-1} M_{\rm D}^T$ terms in the Type-II seesaw formula, provided three right-handed Majorana neutrinos are of ${\cal O}(1)$ TeV and experimentally detectable at the LHC. We propose three simple Type-II seesaw scenarios with the $A_4 \times U(1)_{\rm X}$ flavor symmetry to interpret the observed neutrino mass spectrum and neutrino mixing pattern. Such a TeV-scale neutrino model can be tested in two complementary ways: (1) searching for possible collider signatures of lepton number violation induced by the right-handed Majorana neutrinos and doubly-charged Higgs particles; and (2) searching for possible consequences of unitarity violation of the $3\times 3$ neutrino mixing matrix in the future long-baseline neutrino oscillation experiments.Comment: RevTeX 19 pages, no figure

Fine-Tuning and the Stability of Recurrent Neural Networks

A central criticism of standard theoretical approaches to constructing stable, recurrent model networks is that the synaptic connection weights need to be finely-tuned. This criticism is severe because proposed rules for learning these weights have been shown to have various limitations to their biological plausibility. Hence it is unlikely that such rules are used to continuously fine-tune the network in vivo. We describe a learning rule that is able to tune synaptic weights in a biologically plausible manner. We demonstrate and test this rule in the context of the oculomotor integrator, showing that only known neural signals are needed to tune the weights. We demonstrate that the rule appropriately accounts for a wide variety of experimental results, and is robust under several kinds of perturbation. Furthermore, we show that the rule is able to achieve stability as good as or better than that provided by the linearly optimal weights often used in recurrent models of the integrator. Finally, we discuss how this rule can be generalized to tune a wide variety of recurrent attractor networks, such as those found in head direction and path integration systems, suggesting that it may be used to tune a wide variety of stable neural systems